THE SECOND FUNDAMENTAL THEOREM OF 
INVARIANT THEORY FOR THE ORTHOGONAL GROUP 



GUSTAV LEHRER AND RUIBIN ZHANG 

Abstract. Let V = C™ be endowed with an orthogonal form and G = 0(V) 
be the corresponding orthogonal group. Brauer showed in 1937 that there is 
a surjective homomorphism v : B r (n) — > EndG(U® r ), where B r {n) is the r- 
string Brauer algebra with parameter n. However the kernel of v has remained 
elusive. In this paper we show that, in analogy with the case of GL(V), for 
r > n + 1, v has kernel which is generated by a single idempotent element 
E, and we give a simple explicit formula for E. Using the theory of cellular 
algebras, we show how E may be used to determine the multiplicities of the 
irreducible representations of 0(V) in V® r . We also show how our results 
extend to the case where C is replaced by an appropriate field of positive 
characteristic, and comment on quantum analogues of our results. 



1. Introduction 

Let K be a field of characteristic zero, and let V = K n be an n- dimensional 
vector space with a non-degenerate symmetric bilinear form (—,—), and assume 
that with respect to some basis of V, the form has matrix equal to the identity 
matrix. Equivalently, there is a basis {b\, . . . , b n } such that bj) = such a 
basis is called orthonormal. The orthogonal group 0(V) is the isometry group 
of this form, defined as 0(V) = {g G GL(V) | (gv,gw) = (v,w) V v,w £ V}. 
In [3], Brauer showed that the first fundamental theorem of invariant theory for 
O(V) implies that there is a surjective map v from the Brauer algebra B r (n) 
over K to End ( V ^(V® r ) , but the fact [U [32] that B r (n) is semisimple if and 
only if r < n + 1, has complicated the determination of the kernel of u, and 
therefore limited the use of this fact. 

In this work we determine ker(z^). More specifically, we show that ker(z^) is 
generated as an ideal of B r (n) by a single idempotent E, which we describe 
explicitly Using the fact that B r (n) has a cellular structure [5], we show how 
this fact may be used to illuminate the Schur-Weyl duality between the actions 
of 0(V) and B r {n) on V® r , by using E to describe the radicals of the canonical 
forms on the relevant cell modules of B r (n). 

The special case n = 3 has been treated in [HJ Q2], as has its quantum 
analogue for the Birman-Murukami-Wenzl (BMW) algebra [2]. This latter work 
was done in the context of the 3-dimensional irreducible representation of sfe. 
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The case of the symplectic group Sp 2n (K) and its quantum analogue, which 
seems rather different from the present case, has been treated by Hu and Xiang 
in [8]. 

2. The Brauer algebra 

2.1. Generalities. Let K be a field of characteristic zero and let 5 G K. For 
any positive integer r, the Brauer algebra B r (8) [3] is the K-algebra with basis 
the set of diagrams with 2r nodes, or vertices, labelled as in Figure [I], in which 
each node is joined to just one other one. 



1 



r-1 



r+1 r+2 r+3 



2r-l 2r 



Figure 1. 

Note that each diagram in B r (S) may be thought of as a graph with vertices 
{1, . . . , 2r} in which each vertex is joined to just one other one. We will often 
refer to the 'edges' of such a diagram, and speak of 'horizontal edges' and 'vertical 
edges' (the latter also known as 'through strings') as respectively those joining 
vertices in the same row, or in different rows. 

The composite Di o D 2 of two diagrams D\ and D 2 is obtained by concate- 
nation of diagrams, placing Di above D 2 , with the intermediate nodes and any 
free loops being erased. The product DiD 2 in B r (5) is 5 l ( Dl ' D2 ^ Di o D 2 , where 
l(D\, D 2 ) is the number of deleted free loops. 

We shall need to consider certain special elements of B r (5), which we now 
describe. 

For i — 1, ... ,r — 1, Si is the diagram shown in Figure [2j 



r+1 




i r+i+1 



2r 



Figure 2. 
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For each pair i,j with 1 < i < j < r define the diagram ey as depicted in 
Figure [3J 



i-1 




r+i 



J 



2r 



Figure 3. 

The following facts are all well known. 

Lemma 2.1. (i) The elements s\, . . . , s r _i generate a subalgebra of B r (5), 
isomorphic to the group algebra KSym r of the symmetric group Sym r . 



(ii) The elements satisfy e?j 
commutes with eke- 



Setj, and ifi,j,k and £ are distinct, 



(iii) If we write ej 



for i 



as K-algebra with generators {s 



it 



- 1, B r (5) has a presentation 
-i, ex, . . . , e r _i} ; and relations 



ejei if\i—j\ > 2, and SiS i+1 Si = s i+1 SiS i+1 , eiei ±1 ei = e^ and 
Sie i+1 ei = s i+1 ei, e i+1 eiS i+ i = e i+1 Si and eiSi ±1 ei = e, for all applicable 



SjSi, 



SiGj 



ejSi, e%Cj 



2.2. Some special notation. For positive integers k, I with k < I define [k, I] : = 
{k, k + 1, k + 2, . . . , /}. For any subset S C [1, r], Sym(S') is the subgroup of 
Sym r which fixes each element of [l,r] \ S. For any subgroup H < Sym r , de- 
fine a(H) = ^2 heH s{h)h e B r (S), where e is the alternating character of Sym r . 
This is referred to as the 'alternating element' of KH. The following elementary 
observation is well known but very useful. 



Lemma 2.2. Suppose the subgroup H < Sym r contains the simple transposi- 
tion Sij which interchanges i and j. If e.% j is the element defined above, then 



eija(H) = a(H)e it j = 0. 

Proof. Since Sija(H) = —a(H) = a(H)sij, we have a(H) = |(1 — Sij)a(H) 
2^(-^0(l ^ij}' -But eijSij = SijCij 



ey, and the result is clear. 



□ 



3. The fundamental theorems of invariant theory for 0(n) 

3.1. First (linear) formulation. For any positive integer t the space V® 1 (also 
denoted T*(V)) is an 0(V)-module in the usual way: g{v\®. . .®v t ) = gvi®gv 2 ® 
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...(g) gvt- Moreover the given form on V provides a non-degenerate symmetric 
bilinear form [— , — ] on V® 1 , given by [v\ <g) . . . ®v t , u>i® . . .®w t ] := J^£ <=1 Wi), 
which permits the identification of V rM with its dual space V® f * . 

The space of invariants (y®**) ^) is defined as the space of linear functions 
which are constant on 0(V) orbits. One formulation of the first fundamental 
theorem of invariant theory for O(V) [201 H] is as follows (see [9j [131 113 US], [T8[ 
Proposition 21]). 

Theorem 3.1. The space (y® 1 *} ^) is zero if t is odd. If t = 2r is even, then 
any element of is a linear combination of maps of the form 

j D : vi ® . . . <S> v 2r i-> Yi 

is an edge of D 

where D is a diagram in B r (n). 

The second fundamental theorem provides a description of all linear relations 
among these functions jd- Let us begin by describing some obvious linear rela- 
tions. Suppose r > n + 1 (recall that diml/ = n). 

Let S and S' be disjoint subsets of [l,2r] such that \S\ = \S'\ — n + 1 and 
S PI S' = 0, and let (3 be any pairing of the vertices {1, . . . , 2r} \ (S II S'). 

Definition 3.2. For % e Sym n+1; S = {h, . . . ,i n+1 } , S' = {ji, . . . , j n +i}, let 
D n (S, S', f3) be the Brauer diagram with edges {(ik,jn{k)) \ k = 1,2, . . . , ra+l}IL3 ; 
and denote by 70^(55' 0) the corresponding linear functional on V® 2r as above. 
Define y(S,S',/3) := E 7rGSym„ +1 

The next statement describes some obvious linear relations among the 7^. 

Lemma 3.3. We have, for each S, S', (3 as above, j(S, S', (3) = 0(e (V® 2r )* . 

Proof. If 5" = %\ < %2 < • ■ ■ < i n +i and 5" = j± < 32 < • • • < jn+i, then for any 
t>i<8).. . ®V2r G V® 2r , clearly the (n+1) X (n + 1) matrix with k, I entry (vi k ,Vj ( ) 
is singular, since the rows are linearly dependent, as by dimension, there is a 
linear relation among the i% fc . The lemma follows by observing that j(S,S',ft) 
is a multiple of the function v\ <8> • • • <8> v 2r det(f ifc , Uj-J, which is zero. □ 

The second fundamental theorem for O(V) may be stated as follows [T8l Prop. 
21]. 

Theorem 3.4. If r < n, the 70 form a basis of the space of 0(V) -invariants 
on (y® 2r y . If r > n + 1, then any linear relation among the functionals 7^ is 
a linear consequence of the relations in Lemma \3. 31 

3.2. Second formulation. Our objective is to reinterpret the first and second 
fundamental theorems in terms of the Brauer algebra B r (n), which is the algebra 
described above, with S replaced by n = dim\A For this purpose we consider 
some maps which we now define. There is a canonical map £ : V ®V — > End(V) 
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given by £(v <E> w) : x i-» (ii>,x)'i; (where v,w,x G V). Define A : V"® 27- — )■ 
End(F® r )(~ (End(F))® r ) by 

(g) . . . g) U 2r ) = ® <S> £(^2 ® <8> • • • ® £(^r <& U 2r ). 

This map respects the action of O(V) on its domain and range, where 0(V) 
acts on End(F)® r by conjugation: for # e O(V) and ai <g> . . . <g> a r G End(V)® r , 
<7 • (ai <g> . . . (2) a r ) := ga\g~ l ® . . . (g> ga r g~ x . 

Next observe that if bi,...,b n is an orthonormal basis of V, the element 
70 := X/ILi ^* ® is 0(V")-invariant, and independent of the basis. Hence the 
linear map <p : V ®V — )■ V ® V defined by <p(v <g> w) = 10)70 commutes 
with 0(V"), i.e. G Endo(y) V" 02 . This map is called the contraction map. 
For % = 1,2, ...r — 1, define (pi G End(V® r ) as the endomorphism which is 
the contraction <p on the tensor product of the i th and (i + l) st factors, and is 
the identity on all other factors. It was proved by Brauer [3J that if Sym r C 
B r (n) acts via place permutations on V® r , i.e. if we define, for a G Sym r , 
u(a) ■ (vi <S> ■ ■ ■ ® v r ) = v a -i(i) ® . . . <S> v a -i( r )i then v extends to a homomorphism 
of associative algebras 

v : B r {n) -> End (y)(V® r ) C End(V^ r ) 

by defining v(e.i) = (pi. Note that if o G Sym r the diagram representing a in 
B r {n) has edges (er(i), r + i), for % — 1, 2, . . . , r 

Finally, we define a linear map r : B r (n) — > V® 2r as follows. For any diagram 
D G B r (n), define t(D) = t D , where 

n 

tD= ^2 K®'"®hir> 

il,...,«2r = l 

ij=ik if (j, k) is an edge of D 

where bi,...,b n is an orthonormal basis of V. Notice that tjj is the unique 
element of V® 2r such that in the notation above, 

KM = 7d- 

Now consider the following diagram of linear maps. 

B r (n) 

(3.5) y®2r 1 ^End(F 0r ) 

The next statement is crucial for understanding the second fundamental theorem 
in the context of the Brauer algebra. 



Proposition 3.6. The diagram (13. 5p commutes. 
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Proof. We start by observing that the group Sym r x Sym r acts on each of the 
three spaces in the diagram as follows. Let (o 1; o 2 ) G Sym r x Sym r . Then for a 
diagram D G B r (n), (01, a 2 )-D := a 1 Da 2 1 ; for vi®. . .®v r ®Wi®. . .<8>w r G I/ 027 ", 
(cri, o 2 ) ■ (wi<g). . .<g)tv<g)tyi<g>. . .®w r ) := z/(oi)(vi®. . .®iv)(g)i/(cr2)(iui<8). • .®«v) 5 
and for T G End(V® r ), O^osO-T := u(a 1 )Tp(a 2 ~ 1 ). 

Next, a straightforward computation shows that each of the maps u, r and A 
respects the action of Sym r x Sym r . 

Now each diagram D G B r {n) may be written in the form D = ail(s)a 2 1 for 
some (o"i, o 2 ) G Sym r x Sym r and some diagram l(s), where s G {1, 2, . . . , [^rp]}, 
and the diagram l(s) is as shown in Figure HI 



1 2 3 4 2s-l 2s 2s+12s+2 




Figure 4. 

Hence if we were able to prove that for each s, we have 
(3.7) At(1(s)) = u(1(s)), 

we would have, for (01,02) G Sym r xSym r , Ar(ail(s)a 2 1 ) = (01, 02) • At(1(s)) = 
(o~i,o- 2 ) ■ v(l(s)) = z/(oi/(s)o 2 ~ 1 ), and the Proposition would follow. Hence it 
remains to prove ( 13. 71) . and this may be checked directly, given the identities 

n 

5^6(fci«>&i) =Id v 

i=i 

and 

n 

£0* ® &j) ® ®bj) = (p :V ®V ®V, 

where is the contraction introduced above. □ 

Corollary 3.8. T7ie map z/ maps B r {n) surjectively to Endo(y)(V r(glr ), and 
ker(z/) = ker(r). 

Proof. Since A is an 0(V^)-equivariant isomorphism, it restricts to an isomor- 
phism from the 0(V A )-invariants of V® 2r to those of End(V A(g)r ). It follows from 
Proposition EH that since r has image (V®*) ^, im(z/) = End(V® r )°( y ) = 
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Endo(y)(V A ® r ). The fact that ker(z/) = ker(r) is clear from the commutativity 
of the diagram. □ 

4. Statement of the main result 

4.1. Overview. We shall translate Theorem 13.41 which uses only the linear 
structure, into an explicit description of the ideal ker(z/) above. We start with 
the following easy observation. 

Lemma 4.1. For each triple (S,S',(3) as in Definition \3.2\ define the element 
b(S,S',(3)= Yl e(n)D n (S,S',(3)eB r (n). 

7reSym n+1 

Then the elements b(S,S',/3) span ker(z/). 

Proof. Writing t(S, S', (3) = r(b(S, S', /?)), it is clear that the functional 

x h-> [x,t(S,S',P)] (x e V® r ) 

on V® 2r is equal to j(S, S', /3), which is zero by Lemma [3731 Hence b(S, S', j3) e 
ker(r) = ker(y). It follows from Theorem 13.41 that these elements span the 
kernel. □ 

Next, we identify a small subset of the elements b(S,S',(3) of B r (n), which 
are such that the ideal of B r (ri) which they generate contains, for each triple 
S,S',/3 as in Definition [32], the element b(S, S',/3). By Lemma PO the ideal they 
generate is the whole kernel. We then show that this ideal is in fact generated 
by one of those elements. 

4.2. Formulation. We begin by defining certain elements of B r (n). For this 
purpose, the following notation will be convenient. If k, I are integers such that 
1 < k < I, write a(k, I) := a(Sym{A;, k + 1, . . . , I}) (see §2.21) . By convention, if 
k > I, a(k,l) = 1. 

Definition 4.2. For i = 0, 1, . . . , [^^-] define the following elements of B r (n) 

(i) Fi := a(l, i)a(i + l,n+ 1), where F is interpreted as a(l, n + 1). 

(ii) For j = 0, 1,2, . . . ,i, define e^j) = e i:i+1 ei_ lt i + 2 ■ ■ ■ e;_ i+M+j . This is a 
diagram with j top (resp. bottom) horizontal arcs. Note that ej(0) = 1 
by convention. 

(iii) Using the above notation, define elements Ei (i = 0, 1, ... , [^^-]) as 
follows. 

i 

e, = Y.i-^y^FMm, 

3=0 

where d(j) = ((i - j)!(n + 1 - i - j)!(j!) 2 ) -1 . 

Note that the leading term (j = 0) of E { is (i\(n + 1 - ^)!) _1 i^ 2 = F { . 
Our main result is 
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Theorem 4.3. In the notation of Definition \4 . <\ write E = Ep+ii. Then E 2 = 
(P±±])!(n + 1 - \^})\E. Ifr<n the map v : B r (n) -> Endo (v) (V® r ) is an 
isomorphism. If r > n + 1, ker(z/) is generated as an ideal of B r (n) by E. 

We begin with the following result, whose proof will require arguments in- 
volving the geometry of Brauer diagrams. 

Proposition 4.4. Assume r > n + 1. For each i = 0, 1, . . . , [^j^-], E\ e ker(z/). 

Proof. We shall show that each element Ei is of the form b(S, S', (3) for some 
triple S,S',f3. 

For this, let Si = {1, 2, . . . , i, i + 1 + r, i + 2 + r, . . . , n + 1 + r}, and S^' = 
{z + 1, i + 2, . . . , n + l,r + 1, r + 2, . . . , r + i}. Then |Si| = = n + 1 and 

fl S 1 ^ = 0. In Figure O the points of Si are denoted by o, those of S' { by * and 
the others by •. 



1 

o 



2 

o 



i 

o 



* 



n+l n- 



* * 
r+1 r+2 



* o o 
r+i i+l+r 



O 

n+l+r 



2r 



Figure 5. 

With S,S' as above, {1, . . . ,2r}\ (S t USi) = {n + 2, n + 3, . . . , r, n + 2 + r, n + 
3 + r, . . . , 2r}, and we take to be the pairing (n + 2, n + 2 + r), . . . , (r, 2r). We 
shall show that 

(4.5) E i = b(S i ,S' i ,P i ). 

Now 6(S'i, S'i, fa) is the alternating sum of the set Si of (n + 1)! diagrams of 
the form Figure above, in which each point of Si is joined to a point of S^. Let 
H = Sym{l, . . . ,i}x Sym{z+1, . . . , n+l}, regarded as a subgroup of the algebra 
B r (n). Clearly H x H acts on this set «Sj of diagrams, via (h, h').D = hDh'^ 1 , 
preserving the number of horizontal arcs. Moreover each diagram in <Sj may be 
transformed by H x H into a unique diagram ei(j) for some j = 0, 1, . . . ,i. That 
is, HxH has i+1 orbits on Si, and the ej(j') form a set of orbit representatives. It 
is therefore clear that the alternating sum of the diagrams in the orbit of &i(j) is 
a scalar times F{ei(J)Fi. If the trivial diagram (in the orbit of ej(0) = 1) has sign 
+1, then observing that ei{j + 1) is obtained from e%{j) by a simple interchange 
inS- (of r + i- j with + we see that b(Si, S-, ft) = X] J) (- 1 )''Ci(i)F i e i (j)F i , 
where q(j) is the inverse of \{(h, h!) £ H x H \ hei(j)h' = e,(j')}|. This proves 
(14.51) . and we are done. □ 
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5. Some computations in the Brauer algebra 



In this section, we carry out some necessary computations in the Brauer al- 
gebra B r (5), where 5 is arbitrary, and apply them to prove a key annihilation 
result (Theorem 15.101 below) . 

5.1. Arcs in the Brauer algebra. 

Lemma 5.1. (i) In the group algebra K$ym r , we have, in the notation of< \2.2\ 

fl (SymJ = a(Sym n _ 1 ) - |Sym rt _ 2 |" 1 a(Sym n _ 1 )s„_ 1 a(Sym n _ 1 ). 

(ii) In the K-algebra B T {$), let F = a(l, i)a(i+l, s) and F' = a(l, i — l)a(z+2, s). 
Then for 2 < i < s — 2, 

e M+1 Fe M+1 =(6-8 + 2)F'e hl+1 + [(i - 2)!(s - % - 2)1]^ e iji+1 F 'e^ w F' '. 

(Hi) The statement (ii) above remains true if i = 1, provided that eo,3 is inter- 
preted as 0, and a(k, I) = 1 whenever k > I. 

Proof. The first statement is a simple consequence of the double coset decom- 
position Sym n = Sym^ II Sym n _ 1 s n _iSym n _ 1 . 

For the second, observe that from (i) we have a(l,i) = a(l,i — 1) — (i — 
2)! _1 a(l, i — l)sj_ia(l, % — 1), and a(i + 1, s) = a(i + 2, s) — (s — i — 2)\~ 1 a{i + 
2, s)si + \a{i + 2, s). One now computes directly, using the relations in B r (6), the 
key relation here being ejSj±iej = e^. The third statement, concerning the case 
i = 1, follows from the above argument, but may also be computed directly. □ 

The computation above may be usefully iterated as follows. 

Corollary 5.2. Assume that < i < s — i, and that < j < i — 1. For 

k = 0, 1, . . . , i, write = a(l, i — k)a(i + k + 1, s), so that J Q = F in Lemma 
\5.1\ Jj_! = a(2i, s) and J, t = a(2i + l,s), interpreted as 1 if i = 2s. Write 
e(j) = ei-j + \ t i + j for j = 0, 1, . . . ,i; by convention e(j) = for j > i, and we 
note that e(j)Jk = Jk^{j) for j < k. Then 

(i) We have, for all i,s as above and for j such that < j < i — 1, 




3+1- 



This is consistent with (15. 3p if is interpreted as for k < 0. 
(Hi) With the above notation, we have, for k = 0,1, . . . ,i — 1, 



(5.5) 



e(l) J e(l)e(2) . . . e(k) =A k J 1 e(l)e{2) . . . e{k) 

+ B k J 1 e{l)e{2)...e{k + l)J k 
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where 

A k =k(8 - s + 2) + k(k - 1), and 
(5-6) 1 



(i-k- l)!(s — i — k — l)\ 

(iv) The statement (iii) remains true for k = i, given the conventions for inter- 
preting a(p, q)(— 1) when p> q and e Piq (— 0) when p < 0. That is, 

(5.7) e(l)J e(l)e(2)...e(i) = Me(l)e(2)...e(i), 

where A* = i(5 — s + 2) + i(i — 1) is as given by the formula (15. 6D . 

Proof. For j < % — 1, the statement (i) is simply a translation of Lemma [5711 into 
the present context. When j = i — 1 or i, straightforward calculation shows that 
the formula (15.31) remains true, given the specified conventions. This proves (i) 
and (ii). 

The assertion (iii) is proved by induction on k. First observe that the case 
k = asserts that e(l) Jo = B Jie(l) Jo, where B = u_iyj s , which is easily 
checked. Now suppose that for some fixed k with < k < i — 1, we have 

e(l) J e(l) . . . e(k) = A k J x e{l) . . . e(k) + B k J x e{l) ...e(k + 1) J k . 

Multiplying on the right by e(k + l) and applying (15. 31) to the second term, which 
terminates with e(k + l)Jke(k + 1), a short calculation shows that we obtain 

e(l) J e(l) . . . e(k + 1) = A k+1 Jie(l) . . . e(fc + 1) + B k+1 J ie (l) . . . e(fc + 2) J fc+1 , 

where 

= A fc + S fc (5 - s + 2k + 2){i -k- l)!(s - % - k - 1)! and 
(5 ' 8) = 5,(2 - k - l)(s - % - k - 1). 

The recursion (15. 8p has the unique solution given in (15. 6p . 

Finally, (iv) follows from the case k = i — 1 of (iii), noting that Jj = a(2i + l, s), 
and that the case j = i — 1 of (i) yields that e{i) Jj_ie(i) = (5 — s + 2%)e{%)J i . 
The proof of this last formula involves separate consideration of the cases s = 2i 
and s > 2i. □ 

5.2. A computation in the symmetric group algebra. Fix an integer s 
and for i such that < i < s — i, define Fi(s) := a(l, i)a(i + 1, s), with the usual 
conventions. 

Lemma 5.9. Write KSjm r = (B\I\ for the usual canonical decomposition of 
the group algebra of Sym r into simple two-sided ideals. Then 

(i) The ideal (F^s)) of KSym r generated by Fi(s) is the sum of those I\ 
such that A has at least s — i boxes in its first column and s boxes in its 
first and second column. 

(ii) We have, for 1 < i < f , (F^s)) C (F^s)). 



SECOND FUNDAMENTAL THEOREM 



11 



(iii) There exist elements oei,/3i E B r (5) such that for i as in (ii), Fj_i = 

Proof. The first statement follows easily from the Littlewood-Richardson rule. 
In fact one only requires the (dual of) the Pieri rule. The second and third 
statements follow easily from (i). □ 

5.3. The annihilation theorem. We shall prove the following result. 

Theorem 5.10. Let 6 B r (n), i — 0,1, ... , [^^-] be the elements defined in 
Definition \4 . 2( iii ), and assume that r > n + 1 . Then for j = 1,2, ... ,n, we have 
CjEi = Eiej = 0. 

Proof. It is clear from Lemma [2.21 that ejFi = F^j = for j e {1, 2, . . . ,n + 1}, 
j ^ i. Hence to prove the theorem it suffices to prove that 

(5.11) e i E i = E i e i = 0. 

Moreover, since we have E*j = Ei and e* = where * is the cellular involution 
of B r {n) (reflection in a horizontal), to prove (15. lip , it suffices to prove that 
CiEi = 0, since this implies that (ej-Ej)* = E*e* = Eiei = 0. Thus we are 
reduced to proving that eiEi = 0. 

Maintaining the notation of Definition I4.2[ define elements F^k) = a(l,i — 
k)a(i+k+l, n+l) for k — 0, 1, . . . , i, with the usual conventions applying. Thus 
Fi(0) = Fi. The Fi(k) are analogues of the elements «/& of Corollary I5.2[ and 
translating (iii) of that Corollary into the notation of the elements in Definition 
14.21 we obtain, bearing in mind that here S = n and s = n + 1, 

eiF iei (k) = fe 2 F i (l)e i (fe) + _ - - 1 _ . _ — F^e^k + l)F f (fc), 

for k = 0,1,2, ... ,i. Note that when k = the first term vanishes, and when 
k = i, the second term vanishes, given our conventions. 

It follows that for k — 0,1,2, ... ,i, with the usual notaional conventions, 

(5.12) e l F i e i {k)F l = k 2 F^e^Fi + (i - k)(n + 1 - % - k)Fi(l)e(k + 1)E. 

It follows from (I5.12p that eiEi is a linear combination of Fi(l)ei(j)Fi, for 
j = 1,2, ... ,i Moreover, also by ( I5.12p . the coefficient of Fj(l)ej(/c)Fj in eiEi 
is, in the notation of Definition I4.2( iii). 

(-l) k (k 2 Cl (k) — (i — k+ l)(n + 2-i- k)a(k - 1)) , 

and using the explicit values of the Cj(j'), this is equal to 

{-l) k \ 

1 ; 1 (i - k)\(n + 1 - % - k)\(k - l)! 2 

-{% - k + l)(n + 2 - l - k)— — ; — — rrr^i, 

v /v ' [i - k + l)!(n + 2 - i - k)\(k - l)! 2 

which is equal to zero. 



12 



GUSTAV LEHRER AND RUIBIN ZHANG 



This shows that = 0, and hence completes the proof of the theorem. □ 

Corollary 5.13. Let D be any diagram in B n+ i(n) C B r (n) which has fewer 
than n + 1 through strings (i.e., which has a horizontal arc). Then for i = 
0,1,2,..., p±i] ; DE i = E i D = 0. 

Proof. Fix i as above. If a G Synij x Sym n+1 _j C B n+ x(n), then aEi = ±Ei. 
Now it is clear that for any diagram D as above, there is an element a G 
Synij x Sym n+1 _j such that for some j G {1,2, ... ,n}, Da = D'ej for some 
diagram D' G B n+ i(n). Hence DEi = ±DaEi = ±D'ejEi, which is zero by 
Theorem 15. 101 The proof that EiD = is similar. □ 

Corollary 5.14. The elements Ei are quasi-idempotent. Specifically, we have, 
for i = 0,1,..., [^}, 

E\ = i\(n + l - i)\Ei. 

Proof. Recall that Ei = X^=o( — 1)" ' c «(i)-^ e «(i)-^i- Now it follows from Corollary 
I5.13l that for j > 0, EiFiei(j)Fi = 0, since the second factor is a sum of diagrams 
with at least one horizontal arc. Hence Ef = Ei Y^]=o(~ l) Jc i(j)-^i e i0')-^ = 
EiFi = i\{n + 1 - i)\Ei. □ 

6. Generators of the kernel 
In this section we shall prove 
Theorem 6.1. The ideal ker(^) is generated by E , Ei, . . . , E^n+iy 

6.1. The cellular anti-involution on B r {5). We shall make use of the cel- 
lular anti-involution [5] on B r (8). This is the unique algebra anti-involution 

* : B r (5) — > B r (5) satisfying s* = Si and e* = ei for each i. Then for a G Sym r , 
we have a* = a^ 1 . Geometrically, * may be thought of as reflecting diagrams in 
a horizontal line. 

The proof of Theorem 16.11 will proceed by showing that each of the elements 
b(S, S', (3) lies in the ideal of B r (n) generated by a certain explicit element E^ 
or E*j , and that each of the elements Eij and E*- lies in the ideal generated by 
Ek for some k. 

6.2. Generators and deficiency. Let S, S' be disjoint subsets of {1, . . . , 2r} 

such that \S\ = \S'\ = n + 1. If \S n {1, . . . , r}\ = % and |5" n {1, . . . , r}\ = j, 
then after pre and post multiplying b(S, S', (3) by elements of Sym r C B T {n) and 
possibly interchanging 5* with S' and {1, . . . , r} with {r + 1, . . . , 2r}, we may 
assume that: i < j and i+j > n + 1; the case i+j — n+1 leads to the elements 
Ei. We write — % + j — (n + 1) and refer to this as the deficiency of the pair 
5*, 5". Fix i, j as above. 

For k = 0, 1, . . . , n + 1 — j, let Dij(k) be the diagram depicted in Figure 
O in which the points of S are denoted by o, those of 5" by * and those of 
{l,...,2r}\(SHS')by.. 
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Figure 6. 

The diagram Dij(k) is regarded as an element of B r (n) through the natural 
inclusion Bi(n) B T (n) for any I < r. Note that in the deficiency zero case, 
where i + j = n + 1, the diagram Dy(k) coincides with the diagram eiik) of 
definition I4.2( ii) . 

Definition 6.2. For i,j such that 0<i<j<n+l and i + j > n + 1, define 

E i:j e B r (n) by 

(6.3) 

n+l—j 

Eij = (-iyc ij (k)a(l,i)a(i+l,i+j)D ij (k)a(l,n+l-j)a(n+2-j,n+l-d ij ), 

k=0 

where c^k) = ((n + 1 - j - k)\(n + 1 - i - k)\k\(d i:j + A;)!) -1 . 

Proposition 6.4. (i) The elements and E*j are in ker(^). 

(ii) The kernel ker(z/) is generated as an ideal of B r (n) by the elements E^ 
and E*p where < i < j < n + 1, i + j > n + 1. Here * denotes the cellular 
involution of B r {n), discussed above. 

Proof. The kernel ker(V) is spanned by the elements b(S, S', /3), each of which is 
an alternating sum over Sym n+1 . To see that E^ e ker(z/), we shall show that 
is precisely one of the elements b(S, S', /3), where S = Sij := {1, . . . , z, r + i + 
1 - d^, r + n + 1- dij}, S' = S'^ := {i + 1, . . . , i + j, r + 1, . . . , r + i - (%}, 
and (3 is the pairing of {1, ... , 2r} \ (S1I S') depicted in the diagram Dij(k) for 
any k. 

Observe that from the formula (I6.3p . E^ is alternating with respect to both 
Sym(S') and Sym(S"), for if t is any transposition in Sym(S'), then t- E^ = —E^, 
and similarly for S'. In fact, the constants Cij(k) are chosen so that E^ is 
precisely the alternating sum of (n + 1)! diagrams, obtained from Oy(0) by 
permuting the elements of S. This shows that Ey G ker(z/). Since ker(z/) is 
evidently invariant under *, this proves (i). 

It is straightforward to see that using the action of Sym r on the right and 
left, any pair S, S' of subsets as above may be transformed into a pair Sij, or 
S^, S^, where these sets are as above, with i < j and i + j > n + 1. 
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It follows, since any summand of an element b(S, S', (3), where the pair S 
has deficiency d has at least d horizontal edges, that any element b(S, S', (3) 
may be transformed by Sym r x Sym r into an element of B r (n) each of whose 
diagram summands satisfies the condition that its leftmost i + j part coincides 
with that of E^ or E*j for some i, j, and whose rightmost r — (i + j) part is 
constant for each such summand. Hence 7ib(S, S' , (3)%' = EijD Q or E*jD a for 
some 71,%' G Sym r and D a G B r {n). This proves (ii). □ 

Lemma 6.5. We have, for each i,j and k as above, 

Dij(k) = ei(k + dij)7iij = e^+iej-i,^ . . . ei-k-d^+i^+k+dij^ij , 

and 

n +l- j 

Eij = ^2 (-^) j Cij(k)a(l,i)a(i+l,i+j)ei(k+dij)a(l,n+l-j)a(2i+j-n,i+j)7Tij, 

k=0 

where TVij G Sym r C B r (n) is the permutation defined by 

{I if 1 < I < n + 1 — j or I > i + j 
I + n + 1 — i if i — dij + 1 < I < i + dij 
I - 2dij ifi + dij + l<l<i + j. 
The permutation tt^ is independent of k. 

Proof. The first statement may be directly verified, and the second follows easily, 
by computing 7rya(l, n + 1 — j)a(2i + j — n,i + j)txZ ■ □ 

The next result is required for the proof of Theorem 16.11 



Theorem 6.6. We have, in the above notation, eiEy = for all £ such that 
1 < I <i + j -1. 

Proof. It is clear by Lemma 12.21 that the Theorem holds for I ^ i. It therefore 
suffices to prove that 

(6.7) eiEij = 0. 

To apply the computations of §5.14 it is convenient to rewrite the E^ as follows. 
For d in the range < d < i, write Fij(d) = o(l, i — d)a(i + l + d,i + j). Noting 
that n + 1— j = i + dij, etc., we may rewrite the expression for E^ in Lemma 
16.51 as 

n +l- j 

(6.8) Eij= s i) / 'v,(/.-)/-; / (()) ( ,(/,- • r/,/)/-; ; (^)v,, ; , 

k=0 

Note that the elements Fij (d) are special cases of the elements Jd of Corollary 
15.2^ which may now be applied directly, replacing 5, s and k respectively by 
n, % + j and k + d^ = i + j + k — (n + 1). 

We obtain 
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eiFij(0)ei(k + (h/)/-)- {<!,/) = A k+dij Fij(l)ei(k + d i j)Fi j (d ij ) 
+B k+di:j F ij (l)e i (k + 1 + d ij )F ij (k + d^F^dij) 
=A k+dij F ij (l)e i {k + d ij )F ij (d ij ) 

+(i-k - dij)\(j - k - dij)\B k+dij Fij{l)ei{k + 1 + ). 

It follows that in the expression for fyEy as a sum of the elements G k 
Fij(l)ei(k)Fij(dij)iTij, the coefficient of G k+ \ is 

(A fc+ i +d .. Cii (A; + l) — (i — k — -k- d ij )\B k+d ..c ij (k)) . 

To evaluate this we substitute the actual values of and B^. We have 
A k+di] ={k + dij)(n - (i + j) + 2) + {k + dij)(k + d i3 - 1) 
=k(k + dij), 

while 

B k+dl3 =[(i — l — (k + dijMj — l—(k + di,))]]- 1 . 

Moreover 

Cij (k) = [(d i:j + k)\k\(n + l-j- k)\n + k)]]' 1 . 

Substituting these values into the expression above, we obtain 

1 



A k+1+di .Cij(k + 1) 



(dij + k)\k\(n -j- k)\(n - i - k)\ 
= (i- k- dij)\(j — k — dij)\B k+dij Cij(k). 

It follows that the coefficient of G k in e^E^- is zero, for k = 0, 1, ... ,i — d^. 
Hence eiEij = 0, and the Theorem is proved. □ 

Corollary 6.9. If D is any diagram in B i+ j(n) with at least one horizontal edge, 
then DEij = 0. 

Proof. For any such diagram D, there is a permutation a G Synt^ x Sym^ such 
that Da = D'e^ for some diagram D' e B i+ j(n) and I satisfying 1 < t < — 
The result now follows from Theorem 16 .61 □ 

Corollary 6.10. We have, for each pair i,j with % < j and i + j > n + 1 

Eij e (E k ) for some k with < k < [^]. We also have E*- G (E k ) for the 
same k. 

Proof. It follows from Corollary 16.91 that for any elements x, y G Bi + j(n) and 
any k such that < k < [^rp], we have xE k yEij = xF k yEij, since the other 
summands of the product vanish. Write Fy = Fij (0) in the notation of the proof 
of Theorem I6.6L By the above observation, since FijEij is a non-zero multiple 
of Eij, in order to show that E^ G (E k ), it will suffice to show that there are 
elements x, y G B i+ j(n) such that xF k y = Fij for some k. We shall in fact show 
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that there are elements x, y of KSym i+ j C B i+ j(n) C B r {n) which have the 
desired property. 

Now we have seen that in KSym i+ j, the ideal (Fy) = where A runs 

over partitions of i + j whose first column has at least j elements, and whose 
first two columns have at least i + j elements. But for k = 0, 1, . . . , [^ijr], 
(Fk) = ®^I m u, where /i runs over partitions whose first column contains at 
least n + 1 — k elements, and whose first two columns contain at least n + 1 
elements. Since i + j > n + 1, it follows that for k > n + 1 — j (note that 
i + j > n + l,i < j ==>- n + 1 — j < f 2 ^]), Eij 6 (Fk), whence there are 
elements x, y G KSjm i+ j such that E^ = xF k y, whence E^ G (E k ). 

To show that E*- G (-Efc), observe that by taking the * of Corollary E3H we have 
E*-D = of any diagram in B i+ j(n) with at least one horizontal edge. Hence 
as above, we see that for any elements x,y G B i+ j(n), E*-xE k y = E*jxF k y, and 
the argument proceeds as above. This completes the proof of the Corollary. □ 

We may now complete the 

Proof of Theorem \6.1[ It follows from Proposition 16.41 that ker(z/) is generated 
by the E^ and E*j. But by Corollary 16.101 each of the elements E^ and E*j is 
in the ideal generated by Eq, E\, . . . , E^n+iy Theorem 16.11 follows. □ 



7. Proof of the main theorem 

In this section we complete the proof of Theorem 14.31 The arguments are 
similar to the ones employed in the last section. 

Proof of Theorem \4-3[ The first assertion of the Theorem is a special case of 
Corollary 15 .141 To prove that E = Ern+ii generates ker(z^) we proceed as follows. 
By Proposition 14. 4[ the E^ are in ker(z^), and by Theorem 16 . 1 1 ker ( v) is generated 
by the Ei. The result will therefore follow if we show that 

n + 1 

(7.1) For i — 1, . . . , [ — - — ], Ei_i is in the ideal generated by Ei. 

For if (17. ip holds, then writing (y) for the ideal of B r {n) generated by any 
element y G B r {n) we would have (E) D ^ • • • 2 (Ei) ~D (E ). 

To prove (17. ip . let a,, (3{ be elements of B r (n) as in Lemma [5T9l Then for any i 
such that i < = aiFifii. Consider the element x := Ei_iotiEif3i G (Ei). 

Now OLiEifii = Yl)=a a i E i{j)f3ii where E^j) = ' Ci(j) Fie^j) Fi is a sum of 
diagrams in B n+ i(n) with at least j horizontal arcs. Hence by Corollary 15.131 
Ei^anEiWpi = if j > 0. 

It follows that x = Ei^ictiFifii, since Ei(0) = F«. Hence x = E^iE^i = 
(i — l)\(n—i)\Ei^i G (Ei). This proves (17. II) . and completes the proof of Theorem 
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8. Cellular structure 

It is well known that B r (n) has a cellular structure §4] in which the cells are 
indexed by the set A of partitions A = (Ai > • • • > A p ), with |A| = Y7i=i \ e 7 "> 
where T={tGZ|0<t<r; t = r ( mod 2)}. The partial order on A is 
given by the rule that A < fi if |A| < \fi\, or |A| = and A < \i in the dominance 
order. 

We therefore have cell modules W(X) (A G A) for B r {n). These are endowed 
with a canonical invariant form, whose radical Rad(A) has irreducible quotient 
which we write here as I\. It is part of the general theory of cellular algebras 
that the non-zero I\ form a complete set of representatives of the isomorphism 
classes of B T (n). Now B r (5) is quasi-hereditary [21] whenever 5^0, from 
which it follows that the I\ are each non-zero, and therefore that the irreducible 
£> r (n)-modules are indexed by A. 

Now we have assumed that the characteristic of K is zero. In consequence, 
V® r is semisimple, both as 0(V)-module, and as £? r (n)-module. 

Lemma 8.1. There is a subset A of A such that as 0(V) x B r {n) -module 

where A is the subset of A consisting of partitions whose first and second 
columns have fewer than n+1 elements in total. Here L\ and I\ are respectively 
the simple 0(V) -module and the simple B r (V) -module corresponding to A. 

Proof. The statement that there is a decomposition of the type shown, for some 
subset of A, follows from generalities about double centraliser theory. The iden- 
tification of A in our case follows easily from our Theorem 14.3} but is in any 
case well known. □ 

One consequence of this lemma is the the multiplicity of L\ in V® r is the 
dimension of I\. However in consequence of the non-semisimple nature of B r (n) 
for r > n + 2, these dimensions are not given by purely combinatorial (cellular) 
data. Nonetheless our main theorem is relevant to this decomposition through 
the following result. 

Proposition 8.2. Let E = E< n +ij be the element of B r (n) defined in Definition 

\4-2( iii). Then for A G A , the submodule Rad(A) ofW(X) is given by Rad(A) = 
B r (n)EW{\). That is, Rad(A) is generated by EW{\). 

Proof. First, note that by Lemma I8.1[ I\ is a summand of V® T if and only if 
A G A . Hence A consists of those A such that I\ is annihilated by ker(z^), and 
hence by E since by Theorem 14.31 E generates ker(i/). 

It follows that EW(X) C Rad(A). But the ideal (E) contains the radical 
of the algebra B r (n). Hence by the local criterion proved in [TTJ Theorem 
5.4(3)] for a self dual ideal to contain the radical, it follows that for all A G A, 
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{E)W(X) D Rad(A). It follows that for A G A , (E)W(X) = Rad(A), and the 
Proposition follows. □ 

We conclude this section with the remark that by the above Proposition, we 
have, for A G A , 

W(X) _ W(X) 
X ~ Rad(A) ~ (E)W(XY 
and this makes it possible in principle to compute the dimension of I\ by iden- 
tifying the subspace EW(X) of W(X). 

9. Change of base field, and remarks about the quantum case 

In this section we discuss the situation when the field K has positive char- 
acteristic, as well as the quantum analogue of our result, which applies to the 
Birman-Wenzl-Murakami (BMW) algebra. 

9.1. The case of positive characteristic. When K is an arbitrary field, our 
basic setup remains the same. We still have the map v : B r (n) — > Endo(y)(V® r ), 
and it is still surjective. Proposition 13.61 also remains true. 

It is important to note that although the elements E^ and Eij have denomina- 
tors in their definitions, they are actually linear combinations of diagrams with 
coefficients ±1. Therefore they are elements of the Brauer algebra over Z, and 
may be thought of independently of the ground field. Many of the results above 
remain true for arbitrary K. For any commutative ring R, with 6 G R, write 
B^(5) for the Brauer algebra over R, which may be defined by its presentation 
as given in Lemma l2.1( iii); B^(5) is free over R, with basis the set of Brauer 
diagrams. As usual, B r (n) = B^(n). 

Lemma 9.1. Let K be a field of characteristic other than two. The elements 
b(S,S',(3) G B^(n) of Lemma\4-l\span ker(V). 



This is because the version of the second fundamental theorem in [T8| Prop. 
21] is valid in this generality, and our statement follows from the commutativity 
of the diagram ( 13. 5 p . 

Next we have 

Proposition 9.2. Let K be a field of characteristic other than two. Let E^ G 
B r (n) be the elements defined in Definition \6.2l Then ker(z/) is generated as 
ideal of B T {n) by the Eij,E*j. 

Proof. Note that although the definition of E^ as given involves denominators, 
since E^ is actually one of the elements b(S, S' , /?), it is a Z-linear combination 
of diagrams, and hence may be interpreted as an element of Bf(n), and hence 
of B^(n) for any ring R. 

The proof of the current proposition involves merely the observation that the 
proof of Proposition 16.4( h) remains valid in this more general setting. □ 
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Theorem 9.3. Let K be any ring, and let E^ 6 B^(n) be as in the previous 
proposition. Then for £ with l<£<i + j — 1, we have e^E^ = 0. 

Proof. Although the proof of Theorem 16.61 involves denominators, it is clear that 
it may be restated (and proved in the same way) as a result in Bf(n). Applying 
the specialisation functor K(3z, we obtain the present statement. □ 

Theorem 9.4. Let K be a field of characteristic p > 2(n + 1). Then ker(z^) = 
(E) , where E is the element Ep+ij of Theorem \4-3[ 

Proof. The proofs of Corollary 16.101 and of (17. ip involve computations in the 
group algebra KSjm i+ j. But if the characteristic of K is greater than i+j, this 
algebra is semisimple, and hence the arguments in those proofs apply without 
change. The result follows. □ 

Remark 9.5. It is likely that the conclusion of the above theorem is valid for any 
characteristic other than two. 

9.2. The quantum case. Let U q := U q (o n ) be the smash product of the quan- 
tised enveloping algebra corresponding to the complex Lie algebra so n (C) with 
the group algebra of Z 2 (see [101 §8]). Let C q be the category of finite dimen- 
sional type (1,1,..., 1) representations of U q . Using Lusztig's integral form [H] 
of U q and lattices in the simple [/^-modules, we have a specialisation functor 
S : M q i — y M taking modules M q in C q to their 'classical limit'. 

Let V q be the 'natural' representation of the quantum group U q (o n ), that 
is, the representation which corresponds to the natural representation V of O n 
under the specialisation above. It is well known (cf., e.g. [TP"] ) that there is a 
surjective homomorphism ip : CB r — > Endu q ( 0n ){V® r ) , where B r is the r-string 
braid group, acting through the generalised i?-matrices. 

Moreover this action factors through BMW r (q) = B MW r (q 2 ^~ n \ q 2 — q~ 2 ), 
the Birman-Murukami-Wenzl algebra over C(q) with the indicated parameters. 
The specialisation at q — 1 (see [Til Lemma 4.2]) of BMW r (q) is B r {n). It 
follows from the results of [TOl [Til [T2] . that we have a commutative diagram 
of specialisations as depicted below, which compare the classical case, treated 
above, with the quantum case. 



(9.6) 



-> ker(^) 

5 







-»■ ker(z/) 



BMW r (q) 
s 

BJn) 



q\ q 

s 



->■ 



-> End^ 



->■ 



This diagram naturally leads to the 
Conjecture. In the above notation, there is an element Q q G BMW r (q) such 
that ker(i(j) = The specialisation at q = 1 of $ is E. 
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This was proved for the case n = 3 in [1~2~| Theorem 2.6], where an explicit 
formula was given for $ ? . 

There is another way to generalise the result [T2J Theorem 2.7], which is 
the case n = 3 of our current work. It was shown in [10J that the map 
CB r — > Endt/ q ( S02 )(V^ r ) is surjective, where Vd, q is the g-analogue of the d- 
dimensional representation of U q {so2). It is natural to ask for presentations of 
finite dimensional algebras through which this map factors (cf. [H]). This is 
not likely to be straightforward, because in this case, the generators satisfy a 
polynomial equation of degree d. 
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